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ABSTRACT 

An educational intervention program for lower income 
children was characterized by parent involvement in all stages. 

Active dialogue between parents, teachers and the Boston University 
Head Start Evaluation and Research Center (BUER) was considered a 
primary purpose and encouraged by BUER training, research and service 
activities. An ethical code evolved which committed university 
researchers to a non- traditional research program, open to community 
involvement and criticism. The need for institutional change was 
perceived as more critical than any particular curricular content, 
and the program was closely involved with community problems. Program 
components discussed are: parent involvement in decision making; 
inservice training; observation and feedback; diagnostic and 
follow-up work; and development of a new research tool, the Classroom 
Behavior Form. The complex nature of evaluation is discussed, and the 
use of I.Q. gains to measure the success of intervention programs is 
guestioned. Political, social, and economic goals of Head Start 
programs are cited as more important to the needs of the people 
served than the education per se of young children. Head Start 
evaluation studies should, therefore, include evaluation of these 
goals. (NH) 
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Fo rewo rd 



The intervention described herein was an extraordinary and sus- 
tained involvement with children, teachers, parents and a total com- 
munity. Werwere always in the middle of conflict which we slowly came 
to realize was the result of the poverty and racism in which we live 
rather than the incompetence and self-seeking that it seemed to be. 
Attempts to do something about poverty inevitably run smack into its 
correlates, antecedents and consequences. 

Everyone wants to do something about it, but the chain of circum- 
stances are formidable and, often, impenetrable. Head Start has developed 
a face in the struggle, but one without depth or force. While this 
leads to meagerness and mediocrity, it also produces a point of depart- 
ure unencumbered by traditions. What is true of Head Start will neces- 
sarily be true of evaluators and researchers who tried to make sense 
out of data obtained from Head Start operations and individuals. They 
both have been funded, administered and supervised in the midsts of non' 
existent guidelines, impossible time schedules, continuous delays and 
insufficient personnel. 1he history of confusion, compromise, and con- 
flict in the development of the Evaluation and Research Centers has been 
closely matched by that which has existed throughout the development and 
operation of Head Start Centers. Professionals at both ends worked with 
rules, time schedules, facilities, personnel and policies that would not 
have been acceptable in other circumstances. But this was the poverty 
progranvand we learned to expect little. The most important evaluation 
is not what poverty programs have done, but how it has been done. What 
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have people done together in cities and the rural south which established 
task oriented coalitions that stumbled along? This report is a descrip- 
tion of some of that stumbilng. 

There are many stumbiers who became invoived in our enterprise of 

having residents of a target community play important roies in research 

and evaiuation. The iisting of personnel that foiiows is more than Just 

a iisting, but rather a gratefui acknowiedgement for digging so deepiy 

with us in unexpiored terrain. 

Joan Costiey, evaiuation coordinator 
Pierre Johannet, psychiatry 
Mae Upperman, education 
Esther Wai ters , social service 



Observers 

Mary Adams 
Viola Ai len 
Marjorie Cole 
Nancy Godfrey 
Zita Gray 

Head Start parents, teachers, t 



Fiorene Li tthcut 
Joan McGrath 
Bertha Rogers 
Wilma Snowden 
Patricia Taylor 

inees, neighborhood workers and 



supervisors were enormously helpful both as protagonists and antagonists. 



We often felt that understanding might lead to getting along with people, 
but would not produce change, it is enormously difficult to be honestly 
interested and involved in change while trying to work with individuals 
who you are trying to change. Maybe it is impossible. But we suffered 
with the program and it with us in the valiant but somewhat futile search 
for change. 



Purpose 



The aim of the 1968-69 Boston University Head Start Evaluation and 
Research Center (BUER) interventional program was to create an educational 
system responsive to the needs of children and the desires of parents, 
teachers, and the community. To attain responsiveness in the educational 
system. Head Start staff presented parents, teachers and children with al- 
ternatives and then mobilized community resources so that choices had a 
reasonable chance of being attained. To aid in the presentation and 
realization of alternatives, BUER developed training, research and service 
activities which encouraged and sometimes precipitated dialogue between 
and within teachers, parents, observers, administrators and other profes- 
sionals. The primary purpose of this presentation was dialogue. By-pro- 
ducts pertaining to behaviors and attitudes of children, teachers, ci ass- 
rooms and parents were peripheral and secondary. 



Introduction 



During the past three years, BUER has collaborated with greater Boston 
Head Start Centers on a variety of research activities. Through these 
activities, BUER has discovered rather forcefully that many Individuals in 
lower Income communities do not want to be studied unless study produces 
Immediate results which they can understand and which directly and Immedia- 
tely affects the quality of their lives. At first glance, this attitude 
can be interpreted as revealing an Inability to understand the time gap in 
social science between descriptive and experimental studies and subsequent 
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development of theory and application. However, due to the conditions 
and effects of poverty, the target community views many descriptive and 
expe.rimentai studies as irreievant to their immediate needs. Such re- 
search wiii not have community backing because resuits of these studies 
seem to be disconnected from the significant realities of community life. 
Studies of middle income children and communities, on the other hand, have 
built in controls for relevancy, (which of course, do not always work.) 
Because investigators are studying subjects from similar cultural milieus, 
middie class communities generally share the values and experiences of 
Investigators. As a result, research which Indicates a need for change 
will be considered relevant. Researchers in lower income communities 
lack these built in controls. Instead, values of target communities must 
be carefully weighed and reacted to in order to obtain and maintain 
community be. eking. 

In an effort to fulfill a target community's demand for relevancy, 

BUER initiated a comprehensive interventional program in the South End of 
Boston to study institutional change, while, at the same time, being part 
of that change. The program was characterized by community involvement 
in planning, application, evaluation, and design of research. Each com- 
ponent of the intervention had overlapping research, service, and training 
dimensions, and all were initiated by individuals in the community. Head 
Start staff, or BUER. Every aspect of the intervention has undergone 
continuous evaluation by staff and community groups. This evaluation 
served to generate frequent and sometimes disruptive change in the program, 
and also to encourage active dialogue between parents, teachers, and BUER. 
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D^irtng the intervention an ethical code evolved, partly stated but 
mostly unwritten, concerning the reiations of university researchers to 
icwer inccflie communities. This code became an essentiai feature of a 
research program which had to cope with both an increastngiy miiitant 
community and confiicting university demands. Moreover, the value of 
developing such an ethicai code for constructive rer>earch activity be* 
came apparent when working with the community. Working toward lower 
income communities' assuming important segments of control over their 
lives might very well be more ’important f; the education of children 
than experimenting with particular teaching approaches. 

Weil designed research requires that many decisions be made previous 
to prog ramming--decis ions about staff, selection of children, type of 

/hterventicn, timing and evaluation. These decisions are made on the 

i 

basis of the initial program of research and evaluation, yet they are 
decisions affecting the education of children. That initial research 
program, with its traditional techniques, tests, desig:is, and personnel, 
inevitably leads to rejection of community involvement, even if the com” 
munity has chosen to have evaluation or research. A research program 
which is designed to be sensitive to community demands, cannot be rigidly 
planned in advance. 

BUER encountered the problem of the incompatibility of standard re” 
search techniques with community involvement while obtaining parental 
permission to test children. When parents were approached Individually 
with the usual platitudes about education and testing, permission was 
easily obtained. However, when BUER held open meetings about research 
and invited individuals with a wide spectrum of viewpoints, heated dls” 
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cussions about the reason for testing, cultural bias, educational Im- 
plications, training and values of examiners, and problems of standardi- 
zation were generated. After such a dialogue many parents became leery 
of testing and refused permission. This kind of reaction is not surpris- 
ing from anyone, but especially not from lower income individuals of 
ethnic and racial minorities, who have been exposed to contradictory pro- 
fessional and lay viewpoints. SUER could have sacrificed parental involve 
ment for the sake of traditional research. Parents who arc minimally in- 
formed and convinced of the benevolence of researchers, and the worth of 
science, paper and pencil tests, and the null hypothesis, may be easier 
to work with. However, BUER was committed to community involvement as a 
first principle of research. Therefore, it chose to inform parents about 
Lhe intervention in open community settings with militant viewpoints re- 
presented. At the same time, BUER tried to encourage openness as an 
educational way of life and as a basis for setting up guidelines for staff 
parents, and community involvement. 




Model: Open and Closed Educational Systems 



An educational system is open or ciosed according to its abiiity to 
respond to the desires of children, parents, teachers, administrators and 
other profess ionai s . To be open, a system must, first of aii, be access ibi 
that is, the system must encourage active communication among personnei 
within the system, and parents and professionals outside of the system. 
Secondiy, individuais outside of the system must take advantage of this 
access ibi i i ty to infiuence the system itself. 

An open system, then, is dynamic and charging. Rules which define 
the functioning of the system are tentative; roies of personnel, parents 
and professionals are flexible. A range of alternatives is available to 
aii concerned, and methods for mediating disputes are characterized by 
open accessibility to alternatives. In an open system, the parents and 
community leaders are in continual confrontation, sometimes collaborating 
with teachers, administrators and other professionals in making decisions 
crucial to the educational system, but often embroiled in struggles of 
conflicting values which have been generated by differing life styles. 

Of course, educational systems are open or ciosed to different degrees 
Some systems are technically accessible, but inaccessible in practice. 
School personnel lose contact with individuals both within and without the 
system. Parents lapse in their efforts to maintain an active dialogue 
with teachers and administrators. Procedures which were once innovative 
become standard, and rules and roles lose their flexibility. Creating 
and then maintaining a truly open system requires continual effort and a 
succession of extraordinary strategies. 

The constantly changing nature of the open system tends to breed a 
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feeling of insecurity among its participants. Tension and dissonance wi i i 
resuit because aii participants wiii not be fuiiy committed to the notion 
of a changing system. A ciosed system, on the other hand, provides security 
for its participants. Ruies and roies are carefuiiy prescribed and inno** 
vation is regulated wi thin reiativeiy set iimits. 

The purpose here is not to show that an open system is aiways super- 
ior to a ciosed system, or che contrary. The extent to which a system 
ideaily shouid be open depends on a great msny factors inciuding interests 
of parents, personai ities of administrators and timing. Rather, the ciaim 
here is that the extent to which a system is open and the way in which 
openness is achieved or is diminished is of prime importance in studying 
an educationai system. Moreover, the need for institutional change which 
can best be generated in an open system, is criticai to the education of 
children from iower income commun i ties~-more so than is any particular 
curricular content. Such a ciaim is supported by the fact that even a 
superior educationai system wiii suffer in a iower income community be" 
cause of alienation felt by parents and community leaders when other indi- 
viduals with different values make and carry out aii decisions about edu- 
cational program. The purpose of the BUER intervention was to gauge these 
effects of the opening system while, at the same time, experimenting with 
new procedures to reduce problematic alienation. 




it 

For other discussions of general systems theory and the open-closed 
system distinction see . . . 

Modern Systems Research for the Behavioral Scientist; a source book, , 
Walter Buckley (Ed.). Chicago, 1968. 
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Applicatlon of Model 

An Investigator studying systematic openness has alternatives: he 

can survey many systems, or he can intensively study one or more systems. 
Survey analysis has several limitations. First, no one set of specific 
characteristics is essential in defining an open system. Nor are the 
transactions which compose an open system easily categorized. Any com- 
parisons between systems require controls so that criteria for openness 
are compatible across cases. Instead of surveying many systems, BUER 
opted to intensively study one system while obtaining guidelines from 
a small number of contrasting systems. Thus, a primary goal was to study 
an educational system in a live situation with active and intervening 
agents, including the study team. 

The study and concomittant pursuit of openness in Head Start pro- 
grams, or any educational agencies, is neccessariiy a long, painful 
process impaieu on a contradi ction— the success of the pursuit will in- 
sure the failure of the study. Nevertheless, BUER courageously became 
involved in the following ways: 

Contributing to setting up a public educational system 
independent of the public school system (Head Start); 

Providing an educational program for teachers, and edu- 
cational supervisors, and the Joint development of edu- 
cational goals; 

Attending to problems of physical and mental health and 
nutrition, in the family and the community; 

Reactivating parent advisory councils; 

Placing individuals without formal training in profes- 
sional roles; 
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And, most importantly, creating subsystems with extraor- 
dinarily different structures, sizes, and degrees of 
autonomy. 

To evaluate the extent to which this approach contributed to open- 
ness, the Interaction of parents, teachers, administrators, and resear” 
chers must be observed. General practice and specific episodes become 
the evidence supporting claims that some components of the intervention 
are contributing to openness while others are not. Though the model 
of the system is comparatively simple, analysis is extremely complex 
in that it evolved throughout the intervention. 
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Operational Components of the Intervention 

From 1966 to I969 BUER and greater Boston Head Start centers deve- 
loped projects and activities involving target communities in all stages 
of planning, operation, and evaiuation of educationai programs. These 
projects were designed to encourage the growth of open systems. Through 
the use of various components, aiternatives were presented to parents, 
teachers, and community ieaders; diaiogue was encouraged; and decisions 
were made. A discussion of those six components seiected for the i 968 - 
69 intervention foiiows: 

Parentai involvement in decision making, 

In-service training. 

Observation and feedback. 

Diagnostic and foi iow-up work. 

Development of new research tools. 

Although these components are presented separately, they are closely in- 
terrelated; they should be viewed as overlappi.,g parts of a single thrust 
with the common purpose of promoting openness. 

Parental Involvement in Decision Making 

Involving parents in the decision making process of the Head Start 
program was BUER's most Important but, perhaps, most difficult task. 

BUER's efforts met with limited success. The importance of parental 
participation in the formulation of an educational program for lower in- 
come children cannot be underestimated. Those who generally make decisions 
about the education of children in lower income communities— legislators. 
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adminlstrators , and professionals — are often unacquainted with many real 
Jtles of community life. They do not realize all that goss into slum 
living, shopping in its stores, and sending children to its schools. 
Parents, on the other hand, are on intimate terms with these subjects. 
They add a perspective which inevitably must call for reassessment of 
immediate needs and longterm educational goals. Collaboration between 
parents and professionals, then, can lead to an educational program 
better geared to children's needs, particularly if the parents have or 
obtain necessary knowledge and skills. 

Due to the unique concerns and experiences of lower income communi- 
ties, extraordinary tactics must be used to initiate and sustain paren- 
tal Involvement in formal educational process. What <s a stimulating 
program for middle class parents who have an economic and political 
voice in the education of their children, may be useless to individuals 
who do not have viable educational, economic, political and social 
alternatives. Discussions about carefully balanced diets may seem use- 
less to people who cannot afford to buy the foods belnq discussed. 
Learning how to eliminate rats seens more critical to some lower income 
parents than does studying language development of preschool children. 
Lower income parents are as interested (and as apathetic) about their 
children's education as middle income parents. However, due to the 
effects and concomitants of poverty, they rarely are as involved in the 
planning of tha’t education. 

Parent involvement in educational programs reflects the values and 
attitudes of parents, teachers and administrators. Involvement exists 
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to a greater or lesser extent not because of specific components or pro- 
grams but rather without regard to them. Parent involvemeit may or may 
not reflect the joint values of parents and school officials. If. how- 
ever, the values of parents differ greatly from those of school offi- 
cials, frustration, agitation, alienation and sometimes rebellion re- 
sult. 

At the present time some parents feel relatively disenfranchised and 
want a more effective voice in educational planning, implemention and 
evaluation. Exactly how large this group is is not clear. However, 

BUER and a group of involved parents resolved to discover how many other 
parents believed their involvement was necessary and how many were witling 
to expend time and effort in becoming a more integral part of the program. 

Clearly, many parents were quite happy to have Head Start staff 
plan and run an educational program for their children. They may have 
had complaints about food, bussing, time schedules and rules for eligi- 
bility, but they did not show any desire to become intimately involved 
in policy making and implementation. Whether these parents would have 
liked to take a more active part in planning the educational program, 
and the reasons for their inaction are unclear. But, the fact was that 
most parents were largely uninvolved and passively accepted programs and 
Staff. 

Only when a severe crisis over the continuation of the program or 
a controversial teacher or issue arose, was parent involvement affective 
and widespread. As soon as the crisis was resolved, parents became de- 
tached; they made no provisions for continuing involvement. One can ar- 
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gue that Head Start parents have other concerns that are more pressing 
than the education of their children. Perhaps these concern*.— health, 
housing, clothing, jobs'-requl re most of their time and energy. Perhaps 
mere survival is the main concern for many; Involvement In an educational 
program is a luxur/ they cannot afford. Many families may expend all 
their efforts on survival but certainly not all. At any Income level, 
some parents will be more disposed than others to become active in the 
education of their children. The others will spend their time, money 
and efforts on other concerns. If this is a just assessment of the con- 
cerns of South End parents, then from the parents of one-hundred fifty 
South End children, there should be a nunber who have high enough prior- 
ity to the education of their children to warrant active involvement 
in an educational program. If such involvement is encouraged. 

Because BUER and Head Start staff were operating under the assump- 
tion that parent involvement is essential to openness, BUER devoted much 
time to planning projects to draw parents into various phases of the 
program. Most of these efforts met with outright failure or very limi- 
ted success. 

BUER experimented with a variety of approaches to Initiate paren- 
tal Involvement in the Head Start program and in BUER's intervention. 
BUER organized the Parents Research Advisory Committee to act as consul- 
tant to BUER and as a liaison between BUER and the community. At first 
parents were enthusiastic about communicating their concerns and com- 
plaints to BUER, but they continually decried the lack of communication 
between various agencies and the community. Moreover, they deplored 
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what they saw to be the apathy of other parents as indicated by iow 
attendance at parents meetings. They found that they could only gene- 
rate parental invoivement over particuiariy controversial issues. As 
soon as these issues were resolved, indifference would return. At one 
point, the Parents Committee organized a parents march on a city agency 
to present some demands, inciuding the demand that they be allowed to 
discuss various issues with officiais. The parents were told that they 
could attend the next agency meeting, but they were never notified as 
to when the meeting was scheduled nor that their demands were on the 
agenda. 

As time went on, the Parents Committee expanded its activities to 
inciude the expioration of speciai educational areas such as resources 
avai'iabie for chiidren unabie to attend pubiic school, and possibii ities 
of early entrance into pubiic schooi . Moreover, the Parents Committee 
aided 6UER in planning workshops for parents as well as a parent re- 
source room. The workshops were a limited success due to bad weather, 
timing. and iocation. On the average, eight parents attended each session. 

The parent resource room was conceived as a center in the South 
End where parents wouid find information concerning educationai aitema- 
tives for preschooiers, schooi-age children, and adoiescents. This 
center was to be a place where parents could discover educational al- 
ternatives for all their children. Including those with physical, mental, 
emotional and sensory disabilities. The Parents Committee and BUER made 
plans for the resource room, discussed it, hired personnel for it, and 
even went to New York to study somewhat similar endeavors. However, the 
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Idea never became a reality — the center was never established for many 
reasons, the most prominent one having been the failure of BUER staff 
to realize the extent of differences in values between parents and them- 
selves, and, as a result, BUER's Inability to enter Into a meaningful 
dialogue with examples that would help parents in the reexamination of 
positions and a consequent exchange of responsibilities. 

The Parents Research Advisory Committee was a small group of very 
active parents. The great bulk of the parents, on the other hand, were 
not Intimately Involved in policymaking and implementation. The exact 
reasons for their passivity are not clear. Any number of approaches 
were used to stimulate their Involvement. These approaches will be 
touched on in the discussions of other components of the intervention. 

In-Service Training 

A second component contributing to opening the system was in-ser- 
vice training which provided a link between professional staff and the 
community. Moreover, It engendered a dialogue among teachers, trainees, 
and other professionals. It encouraged flexibility of the various roles 
within the system and eventually led, in some cases, to vocational mo- 
bility without the system. 

The composition of the Head Start staff provided a link between 
the community and professionals. The 1968-69 Head Start staff was made 
up of eleven teachers and sixteen trainees: three teachers and twelve 

trainees were community members who had varied backgrounds; some were 
high-risk employees, others were Neighborhood Youth Corps graduates. 
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and several had one to three years college credit. The youngest was 
^.ighteen, the oldest fifty-one. Thei r experience at working both in 
the community and with young children was considerable. The variety 
of backgrounds among the staff provided insurance that community vaiues 
and needs would be incorporated into program pianning. 

In-service training was particularly suited to stimulating dis- 
cussion and evaluation of teaching techniques. At first, training of 
aides was left mainly to teachers. Eventually a program was instituted 
in which trainees met in small groups to discuss, among themselves, 
various aspects of the educational process. The more experienced 
trainees elected to study effective styles for handling 'teaching pro~ 
blems'. They selected children from their own classes and set up, 
directed, and observed demonstrations. A second group discussed child- 
ren in their own classrooms, and, as a result, became more articulate 
in discussing child development. A third group discussed methods of 
teaching concepts through use of classroom materials. When evaluating 
this program of group study, the trainees expressed discontent with the 
limited resources within the small group and a need to meet in larger 
groups and with teachers and other professionals. Alternative plans 
emerged to replace the group study program. 

Interest -centered meetings were then organized to explore, with 
consultants, concerns peculiar to day care programs. At these meetings, 
trainees, teachers, observers, and neighborhood workers exchanged views 
on programs for children and parents. Trainees observed diagnostic 
sessions and discussed with teachers and consultants ways of dealing 
with children. 
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Trainees, teachers and parents also attended a Boston University 
School of Education faculty meet ing about university Involvement in 
lower Income communities. Community representatives reacted strongly 
not only to what was said, but also to the lack of black faculty mem- 
bers and the whole experience of being on campus. In discussing these 
reactions, university faculty and Head Start staff came upon the idea 
of an off-campus course in early childhood education given for college 
credit. Five trainees and one teacher enrolled. The off-campus course 
provided still another means of stimulating dialogue among trainees, 
teachers, and consultants. 

The increased dialogue exposed teachers, trainees, and consultants 
to one another's discipline and contributed to an increased flexibility 
of roles. Roles were not strictly delineated. Trainees who originally 
were delegated the responsibilities of merely cleaning up became co- 
teachers; parents took on greater decisicn-making responsibilities; 
teachers became supervisors; and supervisors became administrators. In- 
service training made educational facilities more available which led to 
career advancement. At the end of the off-campus course in early child- 
hood education, four of the six participants were accepted into various 
training programs, including a program designed for community people in- 
terested in careers in education. 



Observation and Feedback 

Observation of classrooms and feedback to teachers and parents were 
important steps In creating a substantive dialogue among parents, teachers, 
and observers. Usually parents have little or no idea of what goes on in 
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classrooms beyond what they get from informal generalized reports from 
teachers. In general, teachers seriously discuss only children who 
cause unusual disturbance. Similarly, teachers get little feedback 
from supervisors who must cover so many classes that they can give only 
limited attention to any one class. The function of the observer was 
to concentrate on this type of communication. 

In order to facilitate communication between teachers and parents, ob- 
servers were selected to include both skilled professionals and community 
residents. Because the target community was predominately black, most 
observers were black, though other groups were also represented. In- 
dividuals who had lived in the community for a considerable time and 
were in circumstances similar to the population of parents, made up 
most of the observational team. Very few observers had had extensive 
training or experience in preschool education, and as a result, they 
were sometimes unable to understand the implications of what was happen- 
ing in classrooms. Although much happened in the observer- teacher and 
observer- pa rent interchanges, due to lack of training, the full po- 
tential of the observation and feedback component was not realized. 

Professionals from Head Start and University staff met regularly 
with observers for training sessions. The disciplines of education, 
social work, psychiatry and psychology were all represented at these 
meetings. Graduate students worked along with community residents in 
learning professional skills and their application. The implications 
of the various tasks were discussed in seminars. The training of ob- 
servers led to a closer relationship between BUER and the community. 
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Moreover, ft encouraged some observers to matriculate in formal degree, 
programs . 

Depending on training and aptitude* observers were assigned a 
variety of tasks. Some used both cognitive and social-emotional taisks 
to test children individually. Some observed whole classes using stand- 
ardized procedures. Others observed diagnostic sessions. Some observers 
interviewed parents. Others joined in planning and interpretation of'^ 
these studies as research assistants. All observers were dedicated to 
discussing their observations with teachers* parents, and university 
staff; and ail attended staff meetings of BUER and Head Start to parti- 
cipate In decision making. 

Observers had varied reactions about the importance of their role 
as a vehicle to bringing parents and teachers together. Some observers 
had difficulty establishing good rapport with teachers. Some teachers 
were eager for feedback and were able to use the information to their 
advantage. In other cases, little interchange took place. 

In addition to discussing their observations with teachers, obser- 
bers also Infonr.ed parents about times when they could watch their child- 
ren being tested and the results of those tests. Moreover* observers 
tried to make themselves available so that parents could discuss their 
children's problems. Some observers were more able to stimulate parent 
involvement than others. One observer sent letters to parents of all 
children she had observed. She included her phone number so that she 
would be readily accessible, but she received only one response. In all, 
approximately half of the parents made use of observer's availability. 
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half of the observers at the end of the study had reservations about 
the usefulness of their roie. They feit that the (".eacher could have 
effected parent contact without them whenever the parent was interested 
in feedback. Moreover, they thought that the observer is often more 
of a hindrance to the teacher than a heip. The other group of observers 
were somewhat more enthusiastic about their roie. They had had many 
more successfui feedback experiences and had encountered parents who 
were anxious to engage in a substantive diaiogue about their chiidren. 




Diagnostics and Foi iow-up with Disturbed Chiidren and their Famiiies 

The diagnostic and foiiow-up component was originaiiy designed to 
show parents whose chiidren have speciai emotional or educationai pro- 
biems the various aiternatives open to them and the faciiities avaiiabie 
for treatment of these probiems. The diagnostic component was iooseiy 
organized and aiiowed parents to seek advice either on an informai or 
formal basis. Occasionaiiy a parent requested that a chi id undergo 
diagnostic procedures, but more often than not, chiidren were referred 
by teachers, observers, neighborhood workers, pubiic schoois, sociai 
workers, and famiiy service personnel. If the child's problems was to 
be considered on an informai basis, teachers and neighborhood workers 
met with diagnostic staff consisting of psychiatrists, psychoiogists, 
educational supervisors, social workers, speech and hearing specialists, 
convnunity therapists, and classroom observers. Then Individuals from 
the diagnostic staff would make one or more visits to the classroom to 
observe the child's ongoing activities. 
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The accessibility of the diagnostic unit ai lowed teachers to utliize 
the diagnostic services whenever they had questions regarding a chiid's 
behavior. Such questions arose spontaneousiy tn staff meetings and 
conferences between teachers, trainees, neighborhood workers, and c'ass- 
room observers. Using the specialized knowledge of each of the members 
of the diagnostic team, the teacher couid obtain information about the 
child and his famiiy. Moreover, the style and special abilities of the 
teacher were considered. The chiid's problem was then interpreted in 
the context of the home and the classroom situation. The diagnostic 
team made recommendations to the teacher and the parents about new 
techniques of dealing with the child. Sometimes the recommendations 
took the form of a demonstration with a child or a group of children. 

The main advantage of the informality of the diagnostic component was 
that it encouraged parents and teachers to seek advice about problems 
which might otherwise have been ignored. Moreover, it reduced resis- 
tance to the program by allowing staff to ask questions without for- 
mally committing themselves to a definitive study. The informal approach 
served as an effective training adjunct. And finally, it involved child- 
ren in an on-going program of assessment and feedback to parents. 

When a chiid's problem warranted deeper study, a formal diagnostic 
program was undertaken in collaboration with th^ child's family. Many 
parents were instinctively reluctant to have their child undergo diagnos- 
tic procedures due to their misunderstanding of emotional problems in 
growth and development and their stereotypes of psychiatry and its assoc- 
iation to state hospitals, shock therapy, restraint, and confinement. 
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Thfs stereotyped expectation was responsible for preventing several child- 
ren from obtaining needed services. BUER discovered that the modification 
of this attitude was vital to the successful operation of the diagnostic 
unit. 

If the family was willing to cooperate, formal diagnostic procedures 
were begun. A diagnostic workshop was initiated in which the parent 
participated directly. The formal study included a detailed inquiry in- 
to the family situation and the history of the child. Past medical and 
social records were obtained, and psychological evaluative techniques 
were used. Medical, neurological, and psychiatric specialists were con- 
sulted when necessary. Diagnostic data was interpreted to parents and 
teachers In terms of a child's behavior at home and In school. Alterna- 
tives were then discussed and recommendations for follow-up were made. 

One of five alternative courses was generally recommended. Often 
the diagnostic team recommended that a child remain in his regular Head 
Start class, but that he be given special attention by the teacher under 
clinic guidance. Sometimes children were placed in the Head Start special 
class. The special class was organized to service children with profound 
developmental disturbances who derive minimal benefit or are actually 
harmed by being included in regular classes. These children — the sever- 
ely retarded, the psychoticaliy withdrawn, the disorganized — are unable 
to take advantage of regular educational facilities, and yet have few 
special facilities available to them. For older children who are excluded 
from the public schools for behavioral or learning difficulties, the un- 
graded transitional class was instituted. In this class, a child's needs 
were directly serviced. 
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These classes were not appropriate to the needs of some of the child- 
ren undergoing diagnostics. These children were referred to other schools 
or clinics for direct service. Still other children were given direct 
treatment by the diagnostic staff in conjunction with the South End Family 
Service Clinic. At least half the children who underwent diagnostic treat- 
ment were followed up with a recommended service or referral. 

Instrument Development: A tool for feedback 

BUER needed some means of gauging the effects of the intervention on 
the behavior of Head Start children. To fill this need, a new research 
tool, the Classroom Behavior Form (CRB) was developed. The CRB was de- 
signed to measure a child's productivity in relation to various teacher 
styles and curricula. It provided teachers, observers, and BUER staff 
with a means of evaluating the effectiveness of feedback to teachers, and 
It provided concrete evidence to support other observations. 

The CRB focused on classroom (or playground, or field trip) behavior 
of a single child over a ten minute period which was divided Into thirty 
second segments. Behavior was sampled at various times during the day, 
the week, and the year. The data was then summarized bringing out cen- 
tral tendencies (means) and variabilities (ranges) of behavior In ten 
minute periods during a single day, and in periods spanning several days. 
Observer variability was controlled for by systematic rotation of obser- 
vers and by extracting observer variance. 

The fourteen scales of the CRB fail Into three general groups. The 
first scale describes the extent of the child's productivity. The second 
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group of scales describes the type of productivity in which the child is 
engaged. And the third group records the conditions under which he is 
behaving. The scales are broken down as follows: 

Extent of productivity 

Participation— rejection to intense involvement 
Type of productivity 

Process focus > form--authoritarian to demonstration to experi- 
mental 

Process focus > content— mechanical to skills to percepts to 
concepts to transformations 
Use of materials— irrelevant to creative 
Curriculum— activity to substantive to routine 

Conditions surrounding productivity 

Control, overt and covert- -external to internal 

Behavior--withdrawn to hyperactive 

Social interaction— agents, type and mode 

Role of chi Id- -spectator to participant 

Group size— number of individuals involved in activity 

Correlations between matched observations— two observers watching 

the same child at the same time— range between .30 and .94 with a median 

of . 70 . The scales have been modified and training procedures have been 

revised on the basis of the observer agreement study. 

Observer training involved the following activities: 

Group observation and discussion of classroom behaviors 
Use of total class and single child films and video-tapes 
Readings and discussion of child development including such 
models as those of Guilford, Piaget, Erickson 
Comparisons of two observers recording a child simultaneously 
Observation of children with intellectual and emotional disa- 
bilities 

Seminars with teachers and parents 
Observation of children of different ages 
Use of other, simpler scales 

Discussions of the relation of classroom behavior to behavior 
in other situations, including home, playground and test 
Concurrent recording and video-taping 

Observers, then, were trained extensively so they could both record behavior 
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and discuss their observations with teachers and parents. They gained 
both knowledge of procedures and also understanding of the rationale be- 
hind the use and development of procedures. Moreover, they were able to 
use this knowledge In generating dialogue with parents, teachers, and 
other professionals. 
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Evaluation 



Given a whole series of assumptions, beliefs, values and presumptions, 
we end up (or begin) with a model for intervention which has these charac- 
teristics: 

1. Emerging design 

2. Use of feedback in promoting change 

3* Decisions restinc on community consent 

4. Unifying principie of openness 

But if 'bodei" implies preconceived structures that hold constant 
over a finite period of time and to which can be attributed certain con- 
sistent properties, then what we have Is a non-mode i , one that does not 
lend itself to specific comparisons with more discrete models because its 
shape and size are constantly changing. This produces a dilemma over 
both intermodel as well as intramodel comparisons. Without such a con- 
stant, sustained structure that can be depended upon over time, questions 
about whether children, teachers or parents have changed are, necessarily, 
beyond the scope of this study and its underpinnings. 

One thing that Interventions can do is to superficially affect be- 
haviors during the course of these interventions. We cannot observe 
thought or feeling processes, but we can observe and measure the quality 
and quantity of verbal and social interaction, the physical presence of 
people in settings and mechanical aspects of application. Let us call these 
factors "traffic patterns." "Traffic pattern" Interventions include most 
of what comes under the heading of educational research on teaching, in- 
cluding studies of team teaching, ungraded schools, homogeneous groups 
and tracking. Such interventions affect where individuals are over spe- 
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clfied periods of time and, consequently with whom they are most likely 
to come in contact. "Traffic pattern" aspects of interventiois are dir- 
ectly subject to manipulation and conl;ingent measurement. Presumptions 
are often made about relationships between changing patterns of Inter- 
action and changing ways that children (or adults) think and feel. Usu- 
ally it is never established that the proposed changes in patterns occur- 
red, only that they were intended. Then, explicit criteria are used to 
ascertain whether the intervention was successful, even though it is not 
established that the intervention took place. But to do this, it is 
necessary to show the existence of explicit and desired patterns. The 
question of whether these patterns, once established, will contribute 
to, cause or determine other changes in groups or individuals remains to 
be seen. 

Connections between interventions and criteria are critical. Either 
can be highly specific or very general. Specific criteria are appropriate 
for general interventions. Mismatches (general to specific, specific to 
general) are inappropriate until matched connections can be demonstrated. 
Given the highly probable existence of matched connections, it is then 
appropriate to explore the possibility of their being demonstrable rela- 
tionships between mismatches— for example the possibility that a highly 
specific interventional program will produce generalized results which 
can be inferred from generalized criteria. 

Greater specificity will enhance reliability but limit generalized 
ability. There is always the risk that efforts in the direction of pre- 
cision will lead to highly accurate nonsense. On the other hand, exces- 
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stvely global strategies can result in data that are hopelessly confounded. 
There is serious question about whether the choice of interventional stra- 
tegies and of criteria are the result of the specific theoretical goals 
and other scientific considerations, or whether they are a result of what 
kind of training a person happens to have and what kind of materials and 
instruments are available. Availability probably does more to determine 
what goes into most studies than any scientific, educational or theoreti- 
cal consideration. 

In either case, because educational interventions are necessarily 
of this "traffic pattern" variety (as opposed to drug studies,) the first 
step of any evaluation program is to establish the existence of patterns. 
The BUER intervention directed its attention to prog ram- community-univ- 
ersity dialogue which would open up the program, involve the community 
and take advantage of university facilities and personnel. It was a 
global intervention both in its goal of dialogue as well as In its stra- 
tegies— which were to result in and from dialogue. Strategies become 
criteria, as well as input, for future change. The Intervention must be 
evaluated in tenns of its fecundity for generating these strategies and 
incorporating them and new ideas into the developing system, rather than 
by changes in individuals. Whether interventions and criteria are sys- 
temic or individual depends on how change processes are conceptualized. 
Programs that focus on Individuals and either ignore the system or con- 
sider It distinctly of secondary significance, are as Justified as sys- 
temic programs— but both require intervention-criteria compatibility If 
results are to make any sense. A choice of either presumes that change 
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wilt come about most efficiently if a given hierarchal order is followed. 
This leaves us with the question, do changes in individuals follow or lead 
changes in systems? 

The design of most interventional programs (including Head Start, com- 
pensatory education, therapeutic tutoring) do not make these distinctions. 
For the most part they are rather weighty collections of mismatches. The 
number of ways that I.Q. is used as criteria for every possible type of 
intervention- -whether it be giob^l or specific, systemic or individual — 
suggests that it really does not make any difference what Is happening to 
children Just so long as their !.Q. 's are changing, presumably upward. 

The general rule seems to be, figure out what you would like to do with 
children--if it raises their I.Q. (or some other test score) then It Is 
successful; if not it Is exploratory — no matter what the connection * 

is. 

Every year Head Start Evaluation has featured pre and post I.Q. test** 
ing along with other tests which have varied from year to year. Evalua- 
tions of other interventional programs have used many other tests, but 
always an I.Q. test, usually the S tan ford-6 i net. Why? Because it is the 
best predictor of school success? So the argument goes, if B is corre- 
lated with (predicts) C, then improvement in R will lead to improvement 
in C. And no improvement in 8 will indicate no improvement in C? Or 
perhaps it is not B, but something that leads to B that Is associated 
with C, in which case altering B will leave C unaffected. To compound 
the problem, with regards to Head Start, there are clearly many different 
kinds of programs — different priorities, values, staff, politics, racial 
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atmosphere and facilities. For many programs, education of young chiid- 
ren is a side issue. If education is the highest priority it can be 
doing many different things — socialization, memorization, motivation, 
problem solving, empathy. It might be of a form and content v/hich makes 
a Stanford-Binet I.Q. test the most appropriate instrument to be used as 
a criterion for program success. 

Other programs legitimately consider political, social and economic 
goals as being more appropriate. 

We walked into a run-down boarded up building 
with forty-five children jammed into a room with one 
teacher. It was well over 100° inside. We could not 
understand why there were no other adults or room, or 
why some or ail of the children were not outside, or 
why there were so few materials around.... But there 
were disturbing answers to our questions. The other 
"teachers'* were organizing plantation workers. The 
Head Start program was a front for the community to 
get minimal job security for the fathers of starving 
children. So it occurred to us as we set up our Binet 
kits, maybe we ought to be trying to evaluate the or- 
ganizing of workers rather than wasting time with 
I.Q. tests? 

Episode 

The meeting of ail parents who had children in 
Head Start in that county was held in an old wooden 
church. Every inch of the church, including the 
windows, inside and out, was jammed with people. 

SNCC and CORE workers were passing out literature. 

A movie camera and ki ieg lights were set up and a 
tape recorder was ready to do.... The meeting be- 
gan with a hymn and a prayer. The leader was as 
powerful as he was charismatic — the audience con- 
tinually responding to what he said with yes's and 
noes. Religion and politics surged together in what 
was said and how it was said.... But it was a Head 
Start meeting of parents, staff and the local board. 

They controlled money, an educational program, 
jobs, purchas ing--they being blacks who had never 
controlled very much of anything before. And 
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so we were going to contribute to a national evalua- 
tion by testing kids, observing classrooms, taking 
inventories of facilities and interviewing parents 
about how they felt about head Start? 

We met with a group of parents who wanted to 
know, why we were going to test their children? 

What kinds of test we were going to use? Who was 
going to do the testing? What were the results to 
be used for? And there were a lot of accusations 
and threats. They were in it to run the show. They 
wanted black teachers, black administrators, black 
testers. So we said, "If you feel that way, forget 
it." And they said, "What do you mean forget it?" 

For three years observers had been visiting 
this center, located in an old school house in a 
residential section of a New England mill town. 

Big, airy rooms and lots of supplies, blocks, bicy- 
cles and swings. Seven classrooms, all in a nice 
homey situation, with two, three and sometimes 
four adults in each room, each with twenty children. 

The observers were always trying to figure out what 
those seven classes had in common--what made them 
Into Head Start classes as opposed to any other 
kind of preschool classes. On what basis could 
they be compared? Given the differences in acti- 
vities, rules, materials, demands, social inter- 
actions, authorities, could any one criteria be 
used to compare these classes? They Just did not 
have the same goals. Kids had different opportun- 
ities in each class. 

Head Start was and Is clearly a world of diversity with every kind 
of excellence and mediocrity, dedication and deceit, suffering and stran- 
gulation. It is just this variability of function that is noticibly ig- 
nored in evaluations but which is so crucial to understanding Head Start 
as a social movement. 



Implications for Intervention and the Community 

There were severe contradictions in the administrative and supervisory 
structure of South End Head Start, contradictions that we saw repeatedly 
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In programs throughout the country, but more deeply In the South End be- 
cause we were around longer. As has been recounted above, there were 
many problems in opening up the educational system that was South End 
Head Start. How to get and keep parents involved? How to stimulate 
varied and thoughtful learning experiences for children? How to service 
children with emotional and learning problems? How to provide tead.ers 
with feedback so that they could better service children? How to relax 
traditional professional and administrative barriers? During the inter- 
vention we struggled with these problems among ourselves (BUER) , with 
parents, teachers, administrators, and the community at large. Parents 
were hired as consul tants to assist our deliberations. Community leaders 
were brought in to observe and participate in these deliberations — it 
was certainly necessary that BUER be as open as v/e would have liked Head 
Start to be. By the time the intervention began, BLfER staff consisted of 
mostly community people who were specially trained--the distance between 
university and community was being systematically diminished, or at least 
we thought it was. BUER input into the community was clearly satisfying 
a service commitment to children and families and was building a founda- 
tion for continuity. 

But the system did not open up In any significant way. There were 
certainly some changes in training; disturbed children were serviced; 
teachers were getting more immediate and relevant supervision, and obser- 
vers were constantly in classrooms, talking to teachers and parents and 
informally monitoring the system--the ingredients for openness were pres- 
ent, but they did not go very far as each one stopped where it was left and 
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Head Start staff very rarely picked It up. We got the local delegate 
agency to construct one way observational glass so that two other class- 
rooms had excellent visual and auditory facilities for observing children 
in classrooms. This made it possible for groups of teachers, parents or 
individuals from the community to observe children being taught, playing 
or being tested. They could then sit around and in seminar sessions dis- 
cuss what was being done, why it was being done and how it fitted in with 
the understanding and values of parents. These observation rooms were 
actively used throughout the years that BUER was involved in the South 
End, most intensively during the intervention year. They were used no 
more than six times during the year following the intervention. 

Components developed separately but never coalesced. The role of ob- 
server was a constant dilemma for observers and teachers in the community. 
The argument and the practice of open classrooms was never really under- 
stood by parents, or the community. Diagnostic clinic remains separate 
from other interventional components and, after the termination of the 
interventional program, was continued as an isolated program by another 
clinic. Teachers became reluctant participants of the feedback game, 
but were never Involved, passionate partners. Many parents backed our 
activity and looked to us for support in their struggle with Head Start 
teachers, administrators and rules. But, again. It was not a part of the 
whole thrust. 

In simple terms. Head Start was, and is, publicly supported. education 
(federal) mostly (90%) for children from lowest Income families, generally 
without formal ties to public schools, for preschool children who have 
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a relatively high probability of failing or dropping out of school before 
high school graduation and of being chronically disabled acadeintcai iyc I 
the South End, problems being dealt with by Head Start seemed to be the 
script for how they were to be handled. This is not an evaluation or con 
damnation of South End Head Start — rather it is a statement about the in- 
stitution of Head Start which is made after careful observation and in- 
volvement over an extended period of time. Our observations of other pro 
grams in New England, Mississippi, New York, California and Hawaii have 
served to bring macro- systemic issues and practices into relief. 

Although the relation between poverty and education Is clouded by 
the perennial nature-nurture conundrum, there is little question that 
they affect each other in important and enduring ways. No matter how the 
problem is viewed, it Is quite clear that children and adolescents of low- 
er income families 

h 

spend less time in school 

are behind in academic skills and knowledge 

are less inclined or motivated for education 

are more alienated from the school 

have less use for schools 

than their middle income peers. An important consideration is the inevi- 
table distance between poor people and the schools that are supposed to 
service their children. Our society has changed dramatically — urban con- 
centrations, racial awakening, technological change--but there is real 
question about whether schools have changed at ail, much less kept pace 
with social, political and cultural change. 

Head Start v/as a move in this direct ion--a different population of 
children, federal funding through local agencies, maximum participation 
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of the poor, target community residents as trainees for vocational ungrad- 
ing. Educati'on was to change, at least at the preschool level to keep 
up with the times. The specific physical, mental, emotional and social 
needs of preschoolers from poor families was to be attended to. It was 
to be unencumbered by traditional educational restraints— communi ty in- 
volvement on boards and in classrooms meant that constituencies of boards 
would be economically, socially, and ethnic-racial iy homogeneous. In 
other words, that black parents living in black inner-city areas, would 
control policy regarding the preschool education of their own children, 
Including control of budgeting, staffing, programming and evaluation. 

Head Start v/as conceived not only as an educational program, but as 
a total effort focusing initially on preschool children to upgrade edu- 
cational opportunities for poor children. The poverty program produced 
an Initial wave of idealism and excitement because of its goals and its 
highly imaginative programs. Unfortunately, or perhaps inevitably, the 
implementation of these programs was (and is) erratic and often very 
misleading. 

From the outset, funding of programs has been a succession of night- 
mares — programs that operated for months without funding or with delayed 
funding, last minute budget negotiations, parades of rules and regulations 
about how much money people could be paid, budgetary squeezes between 
hot lunch programs, neighborhood workers and teachers' salaries or anything 
else that happen to be on the budget. Ad hoc staffing policies quickly 
became rigid rules that were developed to meet sometimes real and some- 
times imaginary problems. Trainees have been hired, but never trained — 
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and if they were, they did not obtain a credential that was transferabie. 
Faciiities inciuded every kind of disaster imaginabie, as wei 1 as some 
that were iuxurious. The rule was diversity-double, triple and quad- 
ruple standards that made anything and everything possible, but also 
made it possible to arbitrarily close centers' entire programs and to 
punish those who were too successful in teaching the poor how little 
they really had but how important they were. 

In the South End, faci i ities inciuded church basements, community 
centers, large rooms without partitions, buildings with huge flooding 
and heating problems— an educational operation that was encumbered by 
all of the housing, heating, flooding and toileting problems of the 
community. Although obviously in the South End, or elsewhere, everything 
was not wrong with every building, there were standards of noise, crowd- 
ing, dirt and physical discomfort which hardly made school a place to 
overcome alienation. 

Procedures with regards to hiring staff, setting wages, vacations, 
fringe benefits, working hours and supervision were in constant revision 
and confusion. The professional-community battle was being fought on 
every front. Teachers were driven out or ran away--turnover was relative- 
ly rapid — 75-90% every twelve months. When teachers tried to set up a 
contract with the agency they were rebuked and several were punished. 

The Parents' Advisory Council met very sporadical ly*-during the 
first six months of the intervention it met only once--at tendance was 
miniscule and discussions rarely got into preschool education. 
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With few exceptions the South End did not have supervisors quaiified 
by training, teaching and supervisory experience. Most of the teachers 
were not expiicitiy trained to work with preschooi chiidren. 

With regard to teachers, trainees, and other Head Start staff par- 
ents and the community, it was never apparent that there was a strong 
beiief that preschooi chiidren couid be educated. Head Start was a pi ace 
for chiidren to spend time during the day--to play with other children, 
to get a good lunch, to go on trips, to get medical and dental checkups 
--but it was literally pre school. Many parents were beginning to think 
about education in less formal ways— as not being confined to school or 
to school age--but the commitment to Head Start was always confused and, 
therefore, diffuse. Criteria for establ ishlng policy were, consequently, 
amorphous. Some parents were attracted to reading and writing as criti- 
cal to the development of any cri teria--these were relatively tangible. 
But even then arguments and actions were not convincing because many of 
the parents realized that it was not only that reading and writing was 
what they had had in school but that it was all they had had. 

The problems of administering Head Start programs, and South End 
Head Start In particular, were formidable. To evaluate Head Start they 
have to be understood— both why they existed and the effects they had. 
Implicit in national evaluations of Head Start and In the interventional 
studies of Head Start Evaluation and Research Centers is that administra- 
tive factors are irrelevant and we can afford to ignore them— that Head 
Start is essentially an educational program that can be evaluated and 
best described in educational terms. This necessarily assumes that 
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there Is sufficient child, staff, facilities, methodology and community 
homogen i ety , along with administrative regularity, to warrant asking the 
question and seeking answer^ before the existence of homogeneity and re- 
gularity are verified. 

Our observations in the South End (and in Head Start programs in 
different parts of the country) strongly suggest that administrative 
diversity is, at the same time, the indirect result of poverty, and the 
immediate antecedent for necessary educational and social reforms. The 
whole timing and format of the poverty program is not an accident. The 
existence of the poverty program in the executive Office of the Presi- 
dent has a rather temporary organization without a committed budget and ! 
closely connected with how our society views poverty and how deeply in 
the sand it holds its head. While the precarious ness of the poverty 
program has served to facilitate the development of imaginative pro- 
grams with unprecedented structures and practices, it has also lead to 
an administrative never never land. Without going into the reasons for 
poverty legislation, they are clearly equivocal. There is no long term 
legislative commitment to poverty prog rams —perhaps Head Start, has a 
greater commitment than others. Communities have coped with the vaga- 
ries of Head Start funding, regulations for child eligibility, staffing 
and facilities, in diverse ways depending on what the stakes were. But 
it has rarely been our experience to find a center, or even a class, that 
hat coped to the extent that programs, staff and facilities were actively 
pursuing predominantly educational goals over an extended period of time. 
Now it is possible that this represents either sampling bias**-we Just 
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did not see the right programs — or observational distort ion--we saw the 
right ones but our data are suspect. 

But the oyerai I structure of Head Start practices and iegisiative 
reaiities, inciuding funding, size of Washington and regionai staffs, 
use of iocal administrative units with iittie or no experience in large 
scaie operations and iocations of programs in pooriy serviced, run down 
sium areas, are enough to guarantee that the South End, with or without 
university intervention, wouid be more or iess iike other programs. 

Putting this in another way, pureiy or predominantly educational goais 
are iuxuries that poverty programs cannot afford, particuiariy if they 
are reaiiy deaiing with poverty and foiiowing the letter and spirit of 
maximum’ feas ibie participation of the poor. Disenfranchisement is re** 
iated to poverty as both cause and effect. The poverty cycie cannot be 
broken by more effective teaching methods. This is not a question of 
which communities are sampied, or what kinds of data are obtained. Nor 
is it a question of vaiues— which wouid be better, to spend money on 
education, community action or hospitais?, that is, if community invoive- 
ment is a serious issue. 

The evaluation dilemma is, who and what determine goais, and there- 
fore evaiuation criteria? Because congress passes iegislation establish- 
ing an Office of Economic Opportunity, does it necessarily foiiow that 
the goais of ail programs are to be determined by that congress, that in 
many important ways does not represent the poor? There wouid appear to 
be some serious contradiction between the principie of the poor (or blacks, 
Puerto Ricans, Mexican Americans) participating in programs and the out- 
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side Imposition of goals. Poverty legislation describes goais of Head 
Start in terms of the physical, socfai and inteiiectuai deveiopment of 
prrschooi children whose fami i ies are officiaiiy poor. No parents wouid 
deny the vaiidity of these goais, but many wouid question seiection pro- 
cedures and priorities. It is probably true that the existence of Head 
Start has always depended upon those same inane but unive sally accepted 
legislated goals which made it acceptable to people of diverse persuasions 
and colors. It is not threatening to provide funds for preschool children 
—what else could the money be reasonably used for? Even if poor people 
were to control purse strings it seemed quite clear that Head Start did 
not offer sufficient opportunity for them to gain political benefits. 

At any rate, it is quite clear that Head Start has always been immensely 
popular throughout the country. Even with extremely difficult working 
conditions, substandard wages and equivocal support for the educational 
program from the community and the local agency, there has always been 
an abundance of volunteers, waiting lists for teachers and ready access 
to many community resources. 

This popularity was encumbered by popular (and political) presump- 
tion. about the purposes, values and possibilities of Head Start which 
led legistators, professional and administrative Head Start staff and 
the public to ask whether these goals were being achieved— questions 
which eventually got reduced to I .Q. points. This is not the place to 
explain why a time honored instrument of proven reliability and varia- 
bility can take over much as detail or the proverbial cart. If Head 
Start made children's I.Q.'s go up, it would be a success; if not, it 
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would be a failure. The I.Q. becomes the goal, purpose, aim and end ail. 

It was not that professionals did not seek other instruments — they did 
and invented measures of motivation, socialization, achievement, depend- 
ency, language and productl vi ty--wl thout realizing that when they ran 
out of Binet, they ran out of tests. Within its variability, the Blnet 
includes that which is decipherable in ail of the other tests. Critical 
to this discussion is using or considering Binet performance— or any 
individual test performance— as a legitimate goal of Head Start, both 
in terms of legislative goals as well as those inferred from what is 
actually taking place in Head Start programs throughout the country* 

It is our contention that, because of the reasons discussed above, 
legislated goals are only peripherally related to Head Start operations. 
Children do have medical examinations, many have lunches and even hot 
lunches. The community is involved to a greater or lesser extent. 

But these goals, which have gotten interpreted by Head Start Evaluation 
to be psychometric, are not part of any real action. They may mean 
something to evaluators or developmental psychologists, but they are not 
constructively related to children in Head Start classes as they live 
In their communities and in their homes. Teachers do and say many 
different things in classrooms. Some make very specific demands on child- 
ren. Others encourage them to choose activities, paces, materials, and 
Interactions. For some, parents a.*e critical to early childhood education, 
while for othnrsit is not education at ail. The imposition of any psycho- 
metric criteria on this extreme multi -dimensional variability which is 
Head Start is, at best, naive. 




How then is educational variability to be viewed, described, anaiyz- 
ed, manipuiated and evaiuated? What is the optima1°'*parsimonious, re- 
levant, connected, non-redundant — set of variables and methodologies to 
deal with them, given their number, characteristics, coincidence and 
dependence? What makes a difference in children's educational lives? 

Good teaching? Good relationships? Well organized homes? Good taste 
or good grammar? And how is this to be studied? Are decisions of how 
and what, questions of opinion, tradition, scientific judgement, exper- 
ience, logic or luck? 

The problem for the researcher is to find the smallest number and 
least sized behavioral units that can be studied over the largest num- 
ber of children, teachers and classes. Given any one or more measures, 
appropriateness (as opposed to using more, other or grosser measures) 
depends on sensitivity to manipulation of independent variable(s). If 
certain individuals or groups are manipulated (given a treatment of some 
type) and there is no demonstrable effect, then either the treatment was 
not really given, it had no effect, or the measures used were not sen- 
sitive to treatment. To infer that the treatment was ineffective must 
assume that the treatment did, in fact, take place in a uniform manner 
on comparable samples and that criterion measurements were appropriate 
for determining treatment effects. Similarly, to 'nfer that measure- 
ments are inappropriate assumes that there is reason to believe in the 
effectiveness of the manipulation, that it did effect behaviors of 
children, families and communities, but that this effect was not measured 
(or measurable) — either in the right way, at the best time or In the most 
appropriate units. 






For some manipulations that focus on specific behaviors, criteria 
are predetennined by the manipulation. But educational research must 
eventually study transfer and generalization. What can knowledge and 
skills be used for? The transformation across time, place and material 
take place? These questions cannot be answered mechanically or directly 
There is almost a contradiction between transformation and measurement 
because if transformation is taught it is no longer transformation. 
Testing assumes both a yard stick and an object to which it is applied. 
It is not at all clear that either assumption is satisfied. 

As we view five years of Head Start --prog rams, evaluation and re- 
search — we have an uneasy feeling of discontinuity. Operations have 
gone in many directions with strong regional, community, political and 
social dimensions. Educational effects were always ambiguous and per- 
ipheral, not because of Incompetence, but rather because that is not 
what is was all about, especially in really impoverished communities 
where positive results would be most likely to show, and where most Head 
Start money was being spent. Given local conditions of health, housing, 
transportation, garbage collection and welfare, education has to be 
secondary, no matter what legislation or guidelines say and no matter 
what are the intentions of teachers and other staff. To base evaluation 
and research on the assumption that education is primary is to totally 
ignore what exists In thousands of poor communities throughout the coun- 
try. Until the existence, variability and effectiveness of real, exist- 
ing thrusts of programs established, playing around with educational in- 
put and output data will inevitably be a total waste of time. The deter 
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mination of primary categories of program might permit the study of 
secondary effects, but only after careful pre-selection of programs. 

Almost all evaluation and research efforts to date have acted as if 
education wa& the uniform primary goal of all Head Start operations, and 
as if other effects were more or less non-existent. This sets the stage 
for results thnt are written into a value laden script — change can 
hardly be demonstrated when input is studied obliquely If at all and 
Instruments are used which have been designed to study stability rather 
than change. We have just received a letter from Systems Development 
Corporation (August 6, 1970) indicating that they have received a con- 
tract to study data collected from 1966 to 1969 in order to seek an- 
swers to the question, 'Vhat kinds of Head Start programs are most 
effective for what kinds of children?" It is truly incredible that at 
this late date, after so many data are in, that a major analytical 
effort could continue to so miss the point of asking the same question 
that was futilely raised in the analysis of data collected during 1966, 
the first full year of Head Start. Even if we could distinguish programs 
and children, which we cannot, this effort would be a waste of time be- 
cause it completely ignores program realities which clearly do not adapt 
to "kinds of children." 

Educational questions must wait their turn and their time. The 
important and disturbing questions that can probe into the meaning and 
implications of Head Start have to do with how programs are run, by whom 
and for what reasons, Polly Greenberg's "The Devil Has Slippery Shoes" 
(New York: Macmillan, 1969) is a huge outpouring of data about what one 
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Head Start program was like. But the uniqueness of the experiences of 
the Child Development Group of Mi ssissippi , as startling as it is, is 
not as important to our understanding as the simiiarities which have 
to exist. There is no simpie or right way to deai with poverty and 
racism. Delays, lies, rec.'iminat ion, political intrigue and double 
dealing, personal infighting and assassination, are part and partial 
of the participatory democracy which has always been at the verbal 
foundation of Head Start and other poverty programs. They are not pro- 
blems to be dealt with--they are the action, directly intertwined wi th 
poverty as both cause and effect. 

Our South End intervention was a clear cut example of this pro- 
cess. We went in talking about open systems, communication, feedback, 
parent involvement, maximum feasible participation in education and 
evaluation. We were ready to and did supply the community with a 
badly needed service— screening , diagnosis and treatment for children 
with behavioral disorders. We had the backing of the staff, parents, 
administration and some local political activists. But this was not 
enough-- in fact, nothing could have been enough. We, along with teach- 
ers, trainees and supervisors were chewed up. But the program has en- 
dured, facilities and procedures have become somewhat stabilized and 
professionals and community residents without formal training have 
travelled together through a succession of ambiguous detours. Educa- 
tional programs have been established where previously there had been 
none. Although funding policies have changed over the years, there 
are federal funds supporting local educational programs, with the 



O 

ERIC 



. 1 , 7 - 



possibillty of community involvement in policy and operational decisions. 
The deeper that we got into the South End Head Sta/t, the more blatant 
were the discrepancies between our national testing program and the im- 
portance of this particular poverty program in this community. The 
problems of running the observations and testing program were much more 
relevant to the value and implications of Head Start than were any re- 
sui ts and analyses. 

This is not to make a brief for what Head Start should be like and 
what its goals should be, but rather what reality is and what it has to 
be. Polly Greenberg discusses a crucial issue when she talks about her 
black successor with CDGM: "And she knew some things I would never 
know ever— and neither would the armies of do**gooders like me descending 
suddenly on the poor ail over the country to emancipate them. She knew 
the anguishing pain of change." Head Start cannot be evaluated or even 
remotely understood without coming to grips with that "pain." 




